UCH-L3 (ubiquitin C-terminal hydrolase-L3) is a de-ubiquitinating enzyme that is a component of the ubiquitin-proteasome system and known to be involved in programmed cell death. A previous study of high-throughput drug screening identified an isatin derivative as a UCH-L3 inhibitor. In this study, we attempted to identify a novel inhibitor with a different structural basis. We performed in silico structure-based drug design (SBDD) using human UCH-L3 crystal structure data (PDB code; 1XD3) and the virtual compound library (ChemBridge CNS-Set), which includes 32,799 chemicals. By a two-step virtual screening method using DOCK software (first screening) and GOLD software (second screening), we identified 10 compounds with GOLD scores of over 60. To address whether these compounds exhibit an inhibitory effect on the de-ubiquitinating activity of UCH-L3, we performed an enzymatic assay using ubiquitin-7-amido-4-methylcoumarin (Ub-AMC) as the substrate. As a result, we identified three compounds with similar basic dihydro-pyrrole skeletons as UCH-L3 inhibitors. These novel compounds may be useful for the research of UCH-L3 function, and in drug development for UCH-L3-associated diseases.